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Abstract 

We study the flavor changing t cZ|fZ^ decay in the framework of the general two 
Higgs doublet model, so called model III. We predict the branching ratio for li = t, I2 = n 
at the order of the magnitude of BR ~ 10~^. 
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1 Introduction 



The top quark has a large mass and therefore it breaks the SU{2) x U{1) symmetry maximally. 
Richness of the decay products stimulates one to study its decays to test the standard model 
(SM) and to get some clues about the new physics, beyond. The rare decays of the top quark 
have been studied in the literature, in the framework of the SM and beyond []T|- []TU|; the one- 
loop flavor changing transitions t cg{'y,Z) in 0, 0], t — cV{VV) in and t cH^ in 
i, 0, 1, 1,0- 

These decays are strongly suppressed in the SM and the predicted values of the branching 
ratio (BR) of the process t cg{-f,Z) is 4 x 10"^^ (5 x IQ-^^, 1.3 x lO^^^ ) 0, the BR for 
t cH^ is at the order of the magnitude of 10"^^ — 10^^^, in the SM These prediction are so 
small that it is not possible to measure them even at the highest luminosity accelerators. This 
forces one to go beyond the SM and study these rare decays in the framework of new physics. 
t cH^ decay has been studied in the general two Higgs doublet model (model III) [l^ and it 
has been found that the BR of this process could reach to the values of order 10"^, playing with 
the free parameters of the model III, respecting the existing experimental restrictions. This is 
a strong enhancement, almost seven orders larger compared to the one in the SM. 

The present work is devoted to the analysis of the flavor changing (FC) t ^ c (/f/^ + I1I2) 
decay in the framework of the general two Higgs doublet model (model III). This decay occurs 
in the tree level since the FC transitions in the quark and leptonic sector are permitted in the 
model III. Here, the Yukawa couplings for t — c and — /J transitions play the main role and 
they exist with the help of the internal neutral Higgs bosons, and A^. In the process, it 
is possible to get and resonances since the kinematical region is large enough and this 
difficulty can be solved by choosing the appropriate propagator for and A^ (see section 2). 
In the tree level, the BR of the t — > c(/]"/^ + 1^12) decay for h = t and I2 = fi is predicted 
as 10^^ — 10^^. We also calculate the one loop effects related with the interactions due to the 
internal mediating charged Higgs boson (see Fig. ^ b,c,d) and observe that their contribution 
to the BR is negligible, namely 10^^^ — 10^^*^. 

The paper is organized as follows: In Section 2, we present the BR of the decay t —>■ 
c{lil2 + ^1^/2^) in the framework of model HI. Section 3 is devoted to discussion and our 
conclusions. 
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2 The flavor changing t c (/^ + I1I2 ) decay in the 
framework of the general two Higgs Doublet model 

The flavor changing transition t CI1I2 is forbidden in the SM. Such transitions would be 
possible in the case that the Higgs sector is extended and the flavor changing neutral currents 
(FCNC) in the tree level are permitted. The simplest model which obeys these features is 
the model III version of the two Higgs doublet model (2HDM). This section is devoted to the 
calculation of the BR, in the model HI. In this model, there are various new parameters, such 
as complex Yukawa couplings, masses of new Higgs bosons., etc... and they should be restricted 
by using the present experimental results. 

The t — > CI1I2 process is controlled by the Yukawa interaction and, in the model III, it 



reads 



+ 7]ffiL(plEjR + i§liL(p2EjR + h.c. , (1) 

where L and R denote chiral projections L{R) — 1/2(1 ^ 75), 0j for i — 1,2, are the two scalar 
doublets, QiL are left handed quark doublets, UjR{DjR) are right handed up (down) quark 
singlets, {Ejr) are lepton doublets (singlets), with family indices The Yukawa matrices 
^fj^ and ^fj have in general complex entries. It is possible to collect SM particles in the first 
doublet and new particles in the second one by choosing the parametrization for (pi and 02 as 



\ ^( V2x' 



V2 ( nC+tH^ ) ■ 



with the vacuum expectation values. 



< 01 >= ^ ( ° j ; < 02 >= , (3) 

and considering the gauge and CP invariant Higgs potential which spontaneously breaks 
SU{2) X U{1) down to U{1) as: 

^01,02,03) = Ci(0+0i-^V2)' + C2(0^02)' 

+ +C3[(0+0l - v'/2) + 0+02]' + C4[(0+0l)(0+02) - (0+02)(0r0l)] 

+ C5[i?e(0+02)]' + C6[/m(0+02)]' + C7, (4) 

with constants q, i — 1, 7. Here, Hi and H2 are the mass eigenstates and A° respectively, 
since no mixing occurs between two CP-even neutral bosons and in the tree level, for 
our choice. 
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The Flavor Changing (FC) interaction can be obtained as 

C-Y,FC = eg ^QiL^UjR + ^SQ^L(p2DjR + iffliL<p2E,R + h.C. , (5) 

where the couphngs ^^'^ for the FC charged interactions are 

^ch = VCKM , 

^ch = VCKM ) (6) 

and e^'^ is defined by the expression 

tU{D) _ (T..U{D).-l^U,{D)T,rU{D) /„x 
— \ ^R{L) ) S ^LiR) ■ y' J 

Here the index "N" in ^^'^ denotes the word "neutral". Notice that, in the following, we replace 
^u,D,E ^j^]-^ ^^^'^ where "N" denotes the word "neutral" and define ^^'^'^ which satisfies the 
equation ^^^'^ = y^^^'^'^. 

In the model III, the t c/f decay exists in the tree level, by taking non-zero t—c (/f — ^2^) 
transition with the help of the neutral bosons and ^4°. For completeness, we also take the 
one loop contributions into account (see Fig. 0) and, we use the onshell renormalization scheme 
to get rid of the existing divergences. The method is to obtain the renormalized t ch'^*{A^*) 
transition vertex function 

REN — "T C ' 

REN — "T C ) 

by using 



REN\onshell — V '^^^.'c "i" SiV,cJ "r ISAT.tc <,N,ctn5 

'^RENlonshell = ~ ^ ''^^'^^ ~ ^*ct) + ,tc + ^*ct)l'o ) (9) 



and the counter term 

J- (7 — RENlonshell -L Q \onshell j 
C — REN \ onshell J- o \onshell ■ ) 

where Fq" is the bare vertex function. Here, we take the loop diagrams (see Fig. 0) including 
intermediate boson for FC interaction (Fig. |1]: b,c,d) in the quark sector, since ^^j,^ and 
^Yftt ^'^^ dominant couplings in the loop effects. Therefore, we neglect all the Yukawa couplings 



except ^^ijf, and ^^^^ in the loop contributions. Notice that the self energy diagrams do not 

give any contribution in the onshell renormalization scheme. 

The renormalized vertex function is connected to the I1I2 out going leptons by intermediate 
and bosons as shown in the Fig. ^ and for the matrix element square of the process 

if: — > c (/f /J + 1^12) we get 



= SmUl-s) E \Ps\'{\a'^'\' + \af'\'){{sm^,-{m,--m,,r) 



(0|2 



S=hO,AO 



,(0 „*(0 (Jq) „*(<?) I „'(<?) 

i/jO a AO "T "feo "^0 ) 



where 



+ 16 (1 - ,) ((, - - Rei,,, p> .J? (a< 

+ {smf - {nil- + ^i+f) Re\pho p\o a^o a^o'^ {0^$ ajo^ + a'^o^ aAo'^^)]j , (H) 

i 

Ps = 2 r—- T^' (12) 

s - + ims Tf^t 

is the total decay width of 5 boson, for 5 = A^. Here, the parameter s is s = and 
is the intermediate S boson momentum square. In eq. (|lT]) the functions ajjo^o, o!ho\o have 
tree level conti 
contributions, 



tree level contributions and a^i^o ^'hfi\o are the combinations of tree level and one- loop level 



(I) _ Tree (/) 

^hO,AO ~ ^hO,AO ? 

„(?) _ Tree (q) Loop (q) 

"-hO^AO — "hO^yio -t- "'hO,AO 5 

/(O _ I Tree (I) 

^hO,AO — ^hO,AO 5 

'ig) _ I Tree {q) I Loop {q) /-.^N 



and they read 



Tree(Z) _ __ ( (:E \ (:*E \ 
Tree{l) _ ( tE c*E \ 



iTree{l) _ _J_ ( t:E _ t:*E \ 

/Tree(/) _ ( tE , c*E \ 

~ \^N,hl2 + ^N,l2h) ' 

Tree(g) _ _j_ ( tU , c*U \ 
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where 



with 



Tree{q) _ -*- ( t*U \ 

I Tree (q) _ ^ , c*U \ 

/Tree{q) _ _}_ ( <:U ^ <:*U \ 



+ mfe m* (e^^bb)" / / o?y ((1 - X - y) ff{x, y)) 



- m mt \iN,bb\'^ Jo Jo (*^^ + 

- /""^ dy /f (x, I/) j , 

= v,i (ml i^,, Jl X'' ^^/i"" y) 



- rUb mt {^N*bhf Jo d^ Jo dy({l-x- y) ff{x, y)) 

- rrib mt \iN,bb\'^ Jo Jo ^ 
+ inlb Jl dx f^'^ dy ff {x, y)) , 



I Loop {q) _ Loop(q) 
I Loop (g) Loop (q) 



a;,r^^'^ = a^r^''\ (14) 



L'^(s) = (a; — 1) + m^±x + (— 1 + X + y) (x + sy) , 
L^i^T^s) = (x - 1) + m^iX + (-1 + a; + y) (mj X + m|y) . (16) 



Finally, the differential decay width (dDW) ^{t — > c (/i + ^1^/2 )) is obtained by using the 

X\M\\ (17) 



ds 

expression 

dV 1 



ds 256iVc7r3 



where A is: 



A = 2m[s ■ Here the parameter 



s is restricted into the region ^"'^^r'^^ < s < (JUi^^. Notice that we use the parametrization 
^Nhh ~ l^Nhhl for the leptonic part, in the numerical calculations. 

3 Discussion 

This section is devoted to the analyses of the differential BR (dBR) and the BR of the process 
t ^ c {li^t ~^^i^2) the tree level and also in the one loop level, in the model III. The Yukawa 
couplings ^^ jc and ^N,hi2 P^^Y the main role in the tree level and new couplings, especially 
^^66; ^Ntv enter into calculations if one goes to the loop level. Since these couplings are free 
parameters of the model used, it is necessary to restrict them, using appropriate experimental 
results. We use the constraint region by restricting the Wilson coefficient C^^^ , which is the 



effective coefficient of the operator O7 = ■Y^Sa(J^v{mijR + niaVjhaJ^'^'' (see |TT| and references 
therein), in the region 0.257 < \Cj^^\ < 0.439. Here upper and lower limits were calculated 



using the CLEO measurement [12 



BR{B X,7) = (3.15 ± 0.35 ± 0.32) 10"^ , (18) 

and all possible uncertainities in the calculation of Cj^^ |]TT|. The above restriction ensures 
to get upper and lower limits for .^^f,;,, ^^^^ and also for ^^^^ (see [|lll for details). In our 
numerical calculations we choose the upper limit for Cjff > 0, fix ^^f,;, = 30 mb and take 
tc ~ 0-01 ^w^ti ~ 0.0025, respecting the constraints mentioned. Furthermore, the couplings 
ifj i^i^ in the leptonic part are restricted by using the experimental results, such as, anomalous 
magnetic moment of muon, dipole moments of leptons, rare leptonic decays. For h = t and 
I2 = fJ', we take the upper limit obtained by using experimental result of anomalous magnetic 
moment of muon ||13|. For li = r and I2 = e, we use the numerical result obtained for the 



couplings in |14], based on the experimental measurement of the leptonic process fi ^ e'j 
|T5| . The total decay widths of and are unknown parameters and we expect that they 
are at the same order of mag nitude of F^^^ ~ (0.1 - 1.0) GeV, where is the SM Higgs boson. 
Notice that, we take the value of the total decay width F^ ~ r{t — > bW) as F^ = 1.55 GeV^ 
and choose the numerical values 771^0 = 80 GeV and m^o = 90 GeV, for the calculation of the 
BR. 

In Fig. I, we plot the dBR for the t cij^ji'^ + r+/i^) decay with respect to |^^^^^| 
for sinOT^ = 0.5, different s values, s = (^)^,(^)^,s = (yH)^- Here, we choose .^^^^^ real 
and F^Q^j = F^° = 0.1 GeV. The solid (dashed, small dashed) line represents the case for 
s = (^)2((^)2, (y||)2). From the figure, it is seen that the dBR is at the order of the 
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magnitude of 10"^ for s = (^)^ and ~ 5GeV. dBR is less than 10"*^ for s = {jf^ f and 

s = (yH)^ and it reaches extremely small values for |^^_^^| < IGeV. Increasing |^^^^^| causes 



to enhance the dBR, as expected. Fig. |^ is devoted to the same dependence for s = (^)^ 
(solid line), (^)^ (dashed line), where the values of s are taken at the h'^ and ^4° resonances. 
The dBR is at the order of the magnitude of 10~^ for the small values of the coupling 
and increases extremely with the increasing values of this coupling. 

In Fig. H, we plot the dBR with respect to s, for l^^-^^l = lOGeV, sinOr^ = 0.5 and 
r^^j = F^^ = 0.1 GeV. It is observed that dBR has a strong s dependence. 

Finally, in Fig. |] we present the BR for the process t ^ c {T~fi~^ + with respect to 

|^^,-^| for sinOr^ = 0.5 and F^^" = F^" = 0.1 GeV. The BR is at the order of the magnitude 
of 10~® for l^^.^^! ~ 2 (GeV) and increases to the values 10"'^ with increasing Notice 
that the one loop effects are at the order of the magnitude of 0.1 % of the tree level result and 
therefore their contribution is negligible. 

In the case of outgoing r and e leptons, the BR is predicted at the order of the magnitude 
of 10~^^ — 10^^^, respecting the numerical values of the coupling l^^^el = (10~^ — 10^^) GeV, 



obtained in |1^, based on the experimental measurement of the leptonic process ^ — > 67. For 
the outgoing fi and e leptons, we believe that the BR is extremely small, too difficult to be 
measured. 

At this stage we would like to summarize our results: 

• The BR of the flavor changing process t ^ c{lil2 + It ^2) is forbidden in the SM and the 
extended Higgs sector can bring considerable contribution to the BR in the tree level, at 
the order of the magnitude of 10^^ — 10^'', for h = r and li = fi. A measurement of such 
a BR will be highly non-trivial due to efficiency problems in measuring the r-lepton and 
in identifying a c-quark jet. Moreover, one will have to overcome the problem of isolating 
the signal from possibly large reducible background by applying clever kinematical cuts 
which will further degrade the signal. However, the possible enhancement of the BR of 
the given process in the model III forces one to search new models to get a measurable 
BR theoretically. The BR is sensitive to Yukawa coupling ^^^^^^ respecting the 
experimental limits on the relevant couplings, this results in extremely smaller BR^s of 
t — > c{l{l2 + for h = T, I2 = e and li = ^, I2 = e, compared to the one for 

h = T, I2 = fJ^- Notice that the loop effects are negligibly small. 

Therefore, the future theoretical and experimental investigations of the process t ^ c{lil2 + 
I1I2), especially for li = t, I2 = /i, would play an important role in the determination the 
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physics beyond the SM. 
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Figure 1: Tree level and one loop level diagrams contribute to the decay t 
lines represent the h^,A'^,(f)^, W^, fields. 
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Figure 2: dBR {t ^ c (r" 
siuOt-^ = 0.5, real ^^^^ 
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Figure 3: The same as Fig. ^ but for s 
the case for s = {f^f{{^y). 
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Figure 4: dBR (t ^ c (r /i+ + r+/i )) as a function of s for m/jo = SOGeV, rriAo = 90GeV, 
|CJ,,J = lOGeV, sine,, = 0.5, real and T^^, = t£ = 0.1 GeV. 
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Figure 5: BR (t ^ c{t /x+ + r+/i )) as a function of |Cf ,r/il — ^0 GeF, m^o = 90 GeV, 

sin e,, = 0.5, real ^J^,,, and F^^^, = F^j = 0.1 GeV. 
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